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(57) Abstract 

A touchpad pointing device (12, 12') utilized as a pattern input device for a pattern recognition system. The input pattern (44) 
received from the touchpad pointing device (12, 12*) is translated into a start application command. The recognition system forms part 
of a computer having an operating system (50) and includes a touchpad pointing device (12, 12'), a recognition module (54) and a signal 
capturer (52). In addition, a unit for launching an application to run on a computer having an operating system and a pointing device (12, 
12*) which produces an input pattern (44) in response to movement upon it, is described. Tlie unit includes a recognition module and a 
launcher. The recognition module attempts to recognize the input pattern as a previously trained launching pattern. The launcher launches 
the application by providing a launching command which is associated with the launching pattern to the operating device. A security 
application enables access to the computer upon receipt of an input signature from a user with access privileges. 
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A PATTERN RECOGNITION SYSTEM 



FIELD OF THE INVENTION 

5 The present invention relates to touchpad pointing devices generally 

and to their use for inputting a pattern to be recognized. 

BACKGROUND OF THE INVENTION 

Cursor pointing devices for computers are known in the art, the most 
common of which is a mouse. Typically, "mice" were peripheral devices kept on 
10 the side of the computer and often required a pad along which to slide. With the 
popularity of laptop computers and their continual reductions in size and weight, 
other types of mice have been produced. For example, there are mini trackballs 
which are located in the middle of the keyboard and which are operated through 
pressure. 

15 Fig. 1, to which reference is now made, illustrates a laptop computer 

10 with a further type of cursor pointing device 12, known as a touchpad pointing 
device, and two selecting buttons 14. Although not shown, touchpad pointing 
devices can also be implemented as external devices connectable to a laptop or 
desktop computer. 

20 The touchpad pointing device 12 typically is a flat pad which identifies 

the location of a finger, labeled 16, thereon relative to the edges of the pad or to 
the previous position of finger 16. The touchpad pointing device 12 also includes 
hardware (not shown) which translates the relative position to a position on the 
screen. Thus, as the finger 16 sketches a cuwe 20 on touchpad pointing device 

25 12, a cursor 22 follows a similar curve 24 on a screen 26 of laptop computer 10. 

1 
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When the user has brought cursor 22 to a desired location, such as above the 
word "FILE" as shown, he executes the action by either pressing one of buttons 
14 or tapping on touchpad pointing device 12. 
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SUMMARY OF THE PRESENT INVENTION 

The present invention utilizes touchpad pointing devices as pattern 
input devices. This is accomplished without changing any aspect of the operation 
of the touchpad pointing devices themselves. Furthermore, the present invention 
5 translates the input pattern received from a touchpad pointing device into a start 
application command. 

There is therefore provided, in accordance with a preferred 
embodiment of the present invention, a recognition system forming part of a 
computer having an operating system. The recognition system includes a 

10 touchpad pointing device, a recognition module and a signal capturer. The 
touchpad pointing device produces an input pattern in response to movement 
thereon. The recognition module receives the input pattern and attempts to 
recognize the input pattern. The signal capturer captures the input pattern from 
the touchpad pointing device and provides it to the recognition module if so 

15 activated. The input pattern can be a gesture, a letter, a signature or any other 
pattern. 

There is also provided, in accordance with a second preferred 
embodiment of the present invention, a unit for launching an application to run on 
a computer having an operating system and a pointing device which produces an 

20 input pattern in response to movement thereon. The unit includes a recognition 
module and a launcher. The recognition module receives the input pattern and 
attempts to recognize the input pattern as a previously trained launching pattern. 
The launcher captures the input pattern from the pointing device, provides it to the 
recognition module if so activated and provides a launching command which is 

25 associated with the launching pattern to the operating device, thereby to launch 
an application. 

There is still further provided, in accordance with a third preferred 
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embodiment of the present invention, a security system for a computer which 
includes a security application, a touchpad pointing device, a recognition module 
and a signal capturer. The security application enables access to the computer 
upon receipt of an input signature from a user with access privileges. The 
5 touchpad pointing device produces an input signature in response to movement 
thereon. The recognition module receives the input signature, attempts to 
recognize the input pattern as similar to at least one trained signature associated 
therewith and provides a recognition result to the security application. The signal 
capturer captures the input signature from the touchpad pointing device and 
10 provides it to the recognition module if so activated by the security application. 



4 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the drawings in 
which: 

5 Fig. 1 is a schematic illustration of a prior art touchpad pointing device 

forming part of a laptop computer; 

Figs. 2A and 2B are schematic illustrations of a touchpad pointing 
device utilized as a pattern input device, constructed and operative in accordance 
with a preferred embodiment of the present invention, wherein in Fig. 2A the 
10 touchpad pointing device forms part of a laptop computer and in Fig. 2B the 
touchpad pointing device is an external element connected to a desktop 
computer; 

Fig. 3 is a block diagram illustration of the elements of the computer 
system required to provide the operation shown in Figs. 2A and 2B; 

15 Fig. 4 is a schematic illustration of a translation from an input pattern to 

a start application command; 

Fig. 5 is a block diagram illustration of an application launcher system, 
constructed and operative in accordance with a preferred embodiment of the 
present invention, which utilizes pattern input from a pointing device; 

20 Fig, 6 is a flow chart illustration of a recognition method, useful in the 

system of Fig. 4; and 

Fig. 7 is a flow chart illustration of a training method, useful in the 
system of Fig. 4. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference is now made to Figs, 2A and 2B which illustrate a touchpad 
pointing device utilized as a pattern input device, constructed and operative in 
accordance with a preferred embodiment of the present invention. Elements 
5 which are similar to those of Fig. 1 carry similar reference numerals. Fig. 2A 
shows the touchpad pointing device 12 as part of laptop computer 10 and Fig. 2B 
shows the touchpad pointing device, labeled 12', and buttons 14* as an external 
element 30 connected to a desktop computer 32 having a monitor 34 and 
keyboard 36. For the purposes of the present invention, both touchpad pointing 
10 devices 12 and 12' operate in the same way and, therefore, will be described 
together 

in accordance with a preferred embodiment of the present invention, 
touchpad pointing devices 12 and 12' are utilized to create patterns to be 
recognized. This is accomplished without changing any aspect of the operation of 
15 the touchpad pointing devices 12 and 12' themselves. 

Figs. 2A and 2B show a hand 40 whose finger 42 sketches a pattern 
44 on the associated touchpad pointing device 12 or 12'. Figs. 2A and 2B also 
show a dialog box 46 of a pattern recognition application (not shown) which 
displays a command 47, such as "Draw a Pattern", and the pattern 48 received 
20 thereby. Thus, in accordance with a preferred embodiment of the present 
invention, the movement of finger 42 inputs a pattern rather than moving the 
cursor as in the prior art. 

The pattern recognition application can be any suitable recognition 
application, such as those described in U.S. Patent Applications 08/282,187, 
25 07/978,578, 08/528,293, 08/428,806 ail assigned to the common assignee of the 
present invention and incorporated herein by reference, which receives the input 
pattern 48 and translates it into a character, or set of characters, of a known 

6 
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character set, such as the ASCII character set. For example, the pattern shown in 
Figs. 2A and 2B nnight be translated into the letter "W". Although not shown, it will 
be appreciated that multiple character patterns can also be produced on touchpad 
pointing devices 12 and 12'. 

5 In accordance with a preferred embodiment of the present invention, 

devices 12 and 12' operate both as pointing devices and as pattern input devices. 
Typically, an activation signal must be provided to convert devices 12 and 12' 
from one state to the next. The activation signal can be any hot-key, such as the 
control key, a menu selection, a voice command or a hand-written pattern. 

10 Fig. 3, to which reference is now made, illustrates the elements of the 

computer system, laptop, desktop, palmtop or personal digital assistant (PDA), 
which enable the devices 12 and 12' to operate in two modes. Fig. 3 shows the 
touchpad pointing device 12 and an operating system 50 to which the output of 
pointing device 12 is directly provided in the prior art. In accordance with a 

15 preferred embodiment of the present invention, the computer system also 
comprises a signal capturer 52 which acts between pointing device 12 and 
operating system 50, capturing the output of pointing device 12 (the (x,y) locations 
along the path and the start and stop indications, SS and SE respectively) as well 
as the activation signal. For cursor pointing device operation, signal capturer 52 

20 provides the output of pointing device 12 directly to operating system 50. 
However, after receipt of the activation signal, signal capturer 52 provides the 
output of pointing device 12 to a recognition application 54 which produces a 
recognition result. Signal capturer 52 will continue to do so until receiving a 
deactivation signal, which can be a hot-key operation, a menu operation, or the 

25 closing of the recognition application 54. 

It will be appreciated that the redirection operation of signal capturer 52 
can be a feature of the operating system 50. In this situation, the activation signal 
is provided directly to operating system 50 which then provides the input pattern 

7 
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directly to the recognition application 54. 

in accordance with a further preferred embodiment of the present 
invention, the system of Fig. 3 is operative to provide security to the computer. In 
this embodiment, the input pattern is the user's personal signature which he signs 
5 on the touchpad pointing device 12. After receiving an activation signal from an 
external application, such as a security application or a screen saver which 
requires a password to stop the screen saving action, the signal capturer 52 waits 
for input from the user and redirects the input pattern to the recognition application 
54. Recognition application 54 includes therein at least one trained personal 
10 signature and attempts to match the input pattern with the trained signatures 
associated therewith. Recognition application 54 provides the recognition result 
to the application which provided the activation signal which, in turn, enables 
access to the computer only if the recognition result was positive. 

In accordance with a second preferred embodiment of the present 
15 invention, the input pattern, received from a touchpad pointing device or from any 
other type of pointing device, is translated into a launch application command. 
Thus, a user can write a word, a gesture, or a simple character of his choosing 
with the pointing device and thereby launch an application. For example, the 
almost W-shaped pattern 48 of Figs. 2A and 2B might launch a word processing 
20 application. 

Fig. 4 illustrates an exemplary set of patterns and their associated 
commands. For example, the handwritten W or w will cause a file called 
"Karen.doc" to be edited. The handwritten T causes a different file, "Trip. doc" to 
be edited. The handwritten C launches a calculator program and the handwritten 
25 N launches the Navigator™ browser, commercially available from Netscape 
Communications Corporation of California, USA. 

The system to perform this is shown in Fig. 5, to which reference is 

8 
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now made. In the embodiment of Fig. 5, a launching unit 56. comprising a 
distributor 60 and a launching manager 62, replaces signal capturer 52. 
Furthermore, the recognition application is a matching module 64 which provides 
the results of its pattern matching to launching manager 62 and the pointing 
5 device, labeled 58, can be any type of pointing device. 

Distributor 60 captures the output of pointing device 58 and provides it 
to one or both of launching manager 62 and operating system 50, If launching 
manager 62 is active and if it has received the activation signal, it will provide the 
output of pointing device 58 to matching module 64. If no activation signal has 
1 0 been received, launching manager 62 will ignore the output of pointing device 58. 

Matching module 64 both attempts to match the pattern from pointing 
device 58 to a library 66 of patterns associated therewith and accepts patterns to 
be placed into library 66, in an action known as "training". The library 66 
comprises patterns trained by the user and an identifier for the pattern. The 

15 results of the match (either a rejection or the identifier) are provided back to 
launching manager 62 which converts the identifier to a "launch application" 
command. The identifier can either be an aiphanumerical identifier or a string 
associated with the command. In either case, launching manager 62 provides the 
command associated with the pattern to operating system 50. Launching 

20 manager 62 then ignores further input patterns until it receives a further activation 
signal. 

Figs. 6 and 7 illustrate the method performed by distributor 60. 
launching manager 62 and matching module 64 during recognition and pattern 
training, respectively. The recognition method of Fig. 6 begins by setting, in step 
25 70, matching module 64 to the matching mode. The pattern data is then received 
(step 72) and provided (step 74) to matching module 64. 

In step 76. launching manager 62 calls matching module 64 to perform 

9 
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the recognition and to return the match results. If the match was successful, as 
checked in step 78, launching manager 62 determines the associated command 
and sends the launch application command to operating system 50. 

The training method of Fig. 7 begins by setting, in step 84, matching 
5 module 64 to the training mode. The pattern data is then passed to matching 
module 64 as in the recognition method. Launching manager 62 also receives an 
associated command in step 86, 

In step 88 launching manager 62 calls matching module 64 to train the 
pattern and to associate it with an identifier. Step 90, in which the identifier is 
10 associated with the command, can be performed by matching module 64 or by 
launching manager 62. 

It will be appreciated that the system of Fig. 5 can also operate with a 
voice input pattern. In this embodiment, the pointing device 58 is replaced by a 
microphone and the matching module is a voice pattern matching module. The 
15 remaining elements operate as described hereinabove. 

It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described 
hereinabove. Rather the scope of the present invention is defined only by the 
claims which follow: 
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CLAIMS 

1 . The use of a touchpad pointing device as a pattern input device to a 
pattern recognizer. 

2. A recognition system forming part of a computer having an operating 
5 system, the recognition system comprising: 

a touchpad pointing device for producing an input pattern in response 
to movement thereon; 

a recognition module for receiving said input pattern and for attempting 
to recognize said input pattern; and 

10 a signal capturer for capturing said input pattern from said touchpad 

pointing device and for providing it to said recognition module if so activated. 

3. A recognition system according to claim 2 and wherein said input 
pattern is at least one of the following group: a gesture, a character and a 
signature. 

15 4. A unit for launching an application to run on a computer having an 

operating system and a pointing device, the pointing device producing an input 
pattern in response to movement thereon, the unit comprising: 

a recognition module for receiving said input pattern and for attempting 
to recognize said input pattern as a previously trained launching pattern; and 

11 
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a launcher for capturing said input pattern from said pointing device, 
for providing it to said recognition module if so activated and for providing a 
launching command, associated with said launching pattern, to said operating 
device, thereby to launch an application. 

5 5. A security system for a computer, the security system comprising: 

a security application for enabling access to said computer upon 
receipt of an input signature from a user with access privileges; 

a touchpad pointing device for producing an input signature in 
response to movement thereon; 

10 a recognition module for receiving said input signature, for attempting 

to recognize said input pattern as similar to at least one trained signature 
associated therewith and for providing a recognition result to said security 
application; and 

a signal capturer for capturing said input signature from said touchpad 
15 pointing device and for providing it to said recognition module if so activated by 
said security application. 



12 
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